Longitudinal Self-Supervision for COVID-19 Pathology Quantification (preprint)

Quantifying COVID-19 infection over time is an important task to manage the hospitalization of patients during a global pandemic. Recently, deep learning-based approaches have been proposed to help radiologists automatically quantify COVID-19 pathologies on longitudinal CT scans. However, the learning process of deep learning methods demands extensive training data to learn the complex characteristics of infected regions over longitudinal scans. It is challenging to collect a large-scale dataset, especially for longitudinal training. In this study, we want to address this problem by proposing a new self-supervised learning method to effectively train longitudinal networks for the quantification of COVID-19 infections. For this purpose, longitudinal self-supervision schemes are explored on clinical longitudinal COVID-19 CT scans. Experimental results show that the proposed method is effective, helping the model better exploit the semantics of longitudinal data and improve two COVID-19 quantification tasks.

Interactive Segmentation for COVID-19 Infection Quantification on Longitudinal CT scans (preprint)

Consistent segmentation of COVID-19 patient's CT scans across multiple time points is essential to assess disease progression and response to therapy accurately. Existing automatic and interactive segmentation models for medical images only use data from a single time point (static). However, valuable segmentation information from previous time points is often not used to aid the segmentation of a patient's follow-up scans. Also, fully automatic segmentation techniques frequently produce results that would need further editing for clinical use. In this work, we propose a new single network model for interactive segmentation that fully utilizes all available past information to refine the segmentation of follow-up scans. In the first segmentation round, our model takes 3D volumes of medical images from two-time points (target and reference) as concatenated slices with the additional reference time point segmentation as a guide to segment the target scan. In subsequent segmentation refinement rounds, user feedback in the form of scribbles that correct the segmentation and the target's previous segmentation results are additionally fed into the model. This ensures that the segmentation information from previous refinement rounds is retained. Experimental results on our in-house multiclass longitudinal COVID-19 dataset show that the proposed model outperforms its static version and can assist in localizing COVID-19 infections in patient's follow-up scans.

U-GAT: Multimodal Graph Attention Network for COVID-19 Outcome Prediction (preprint)

During the first wave of COVID-19, hospitals were overwhelmed with the high number of admitted patients. An accurate prediction of the most likely individual disease progression can improve the planning of limited resources and finding the optimal treatment for patients. However, when dealing with a newly emerging disease such as COVID-19, the impact of patient- and disease-specific factors (e.g. body weight or known co-morbidities) on the immediate course of disease is by and large unknown. In the case of COVID-19, the need for intensive care unit (ICU) admission of pneumonia patients is often determined only by acute indicators such as vital signs (e.g. breathing rate, blood oxygen levels), whereas statistical analysis and decision support systems that integrate all of the available data could enable an earlier prognosis. To this end, we propose a holistic graph-based approach combining both imaging and non-imaging information. Specifically, we introduce a multimodal similarity metric to build a population graph for clustering patients and an image-based end-to-end Graph Attention Network to process this graph and predict the COVID-19 patient outcomes: admission to ICU, need for ventilation and mortality. Additionally, the network segments chest CT images as an auxiliary task and extracts image features and radiomics for feature fusion with the available metadata. Results on a dataset collected in Klinikum rechts der Isar in Munich, Germany show that our approach outperforms single modality and non-graph baselines. Moreover, our clustering and graph attention allow for increased understanding of the patient relationships within the population graph and provide insight into the network's decision-making process.

Longitudinal Quantitative Assessment of COVID-19 Infection Progression from Chest CTs (preprint)

Chest computed tomography (CT) has played an essential diagnostic role in assessing patients with COVID-19 by showing disease-specific image features such as ground-glass opacity and consolidation. Image segmentation methods have proven to help quantify the disease burden and even help predict the outcome. The availability of longitudinal CT series may also result in an efficient and effective method to reliably assess the progression of COVID-19, monitor the healing process and the response to different therapeutic strategies. In this paper, we propose a new framework to identify infection at a voxel level (identification of healthy lung, consolidation, and ground-glass opacity) and visualize the progression of COVID-19 using sequential low-dose non-contrast CT scans. In particular, we devise a longitudinal segmentation network that utilizes the reference scan information to improve the performance of disease identification. Experimental results on a clinical longitudinal dataset collected in our institution show the effectiveness of the proposed method compared to the static deep neural networks for disease quantification.

SARS-CoV-2 serology increases diagnostic accuracy in CT-suspected, PCR-negative COVID-19 patients during pandemic (preprint)

Background:In the absence of PCR detection of SARS-CoV-2 RNA, accurate diagnosis of COVID-19 is challenging. Low-dose computed tomography (CT) detects pulmonary infiltrates with high sensitivity, but findings may be non-specific. This study assesses the diagnostic value of SARS-CoV-2 serology for patients with distinct CT features but negative PCR.Methods:IgM/IgG chemiluminescent immunoassay was performed for 107 patients with confirmed (group A: PCR+; CT±) and 46 patients with suspected (group B: repetitive PCR-; CT+) COVID-19, admitted to a German university hospital during the pandemic’s first wave. A standardized, in-house CT classification of radiological signs of a viral pneumonia was used to assess the probability of COVID-19.Results:Seroconversion rates (SR) determined on day 5, 10, 15, 20 and 25 after symptom onset (SO) were 8%, 25%, 65%, 76% and 91% for group A, and 0%, 10%, 19%, 37% and 46% for group B, respectively; (p<0.01). Compared to hospitalized patients with a non-complicated course, seroconversion tended to occur at lower frequency and delayed in patients on intensive care units. SR of patients with CT findings classified as high certainty for COVID-19 were 8%, 22%, 68%, 79% and 93% in group A, compared with 0%, 15%, 28%, 50% and 50% in group B (p<0.01). SARS-CoV-2 serology established a definite diagnosis in 12/46 group B patients. In 88% (8/9) of patients with negative serology >14 days after symptom onset (group B), clinico-radiological consensus reassessment revealed probable diagnoses other than COVID-19. Sensitivity of SARS-CoV-2 serology was superior to PCR >17d after symptom onset.Conclusions:Approximately one-third of patients with distinct COVID-19 CT findings are tested negative for SARS-CoV-2 RNA by PCR rendering correct diagnosis difficult. Implementation of SARS-CoV-2 serology testing alongside current CT/PCR-based diagnostic algorithms improves discrimination between COVID-19-related and non-related pulmonary infiltrates in PCR negative patients. However, sensitivity of SARS-CoV-2 serology strongly depends on the time of testing and becomes superior to PCR after the 2nd week following symptom onset.

Intensive care risk estimation in COVID-19 pneumonia based on clinical and imaging parameters: experiences from the Munich cohort (preprint)

Background: The rapidly evolving dynamics of coronavirus disease 2019 (COVID-19) and the steadily increasing infection numbers require diagnostic tools to identify patients at high risk for a severe disease course. Here we evaluate clinical and imaging parameters for estimating the need of intensive care unit (ICU) treatment. Methods: We collected clinical, laboratory and imaging data from 65 patients with confirmed COVID-19 infection based on PCR positivity. IL-6, CRP, leukocyte and lymphocyte counts were determined in blood samples. Two radiologists evaluated the severity of imaging findings in computed tomography (CT) images on a scale from 1 (no characteristic signs of COVID-19) to 5 (confluent ground glass opacities in over 50% of the lung parenchyma). The volume of affected lung was quantified using commercially available software. Machine learning modelling was performed to estimate the risk for intensive care unit treatment. Findings: Patients with a severe course of COVID-19 had significantly increased IL-6, CRP and leukocyte counts and significantly decreased lymphocyte counts. The radiological severity grading was significantly increased in ICU patients. Multivariate random forest modelling showed a mean +/- standard deviation sensitivity, specificity and accuracy of 0.72 +/- 0.1, 0.86 +/- 0.16 and 0.80 +/- 0.1 and a ROC-AUC of 0.79 +/- 0.1. The most important predictive parameters were affected lung volume, radiological severity score, CRP and IL-6. Summary and Conclusion: Estimation of need for intensive care treatment is possible based on the clinical and radiological parameters.